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I.  INTRODUCTION  .  y 

'' 

A  noise  phenomenon  which  is  often  dominant  at  low  frequencies 
is  comprised  of  those  processes  which  are  called  1/f  noise,  flicker 
effect,  and  sporadic  processes.  These  processes  are  characterized 
by  a  power  spectral  density  which  varies  as  l/jf|^  where  0^0i^2. 

They  have  been  observed  over  a  wide  range  of  frequencies  in  such 
diverse  situations  as  vacuum  tube  anl  semiconductor  noise,  the  spec¬ 
trum  of  sea  waves,  and  ultra- precise  time  standards.  Some  of  these 
processes  are  not  admissable  in  the  usual  Wiener- Khinchin  theory  of 
random  processes.  On  the  other  hand,  their  extensive  occurrence 
suggests  that  some  accommodation  must  be  made  for  them  in  the 
organised  theory. 

It  is  usually  assumed  that  noise  processes  are  sample  functions 
of  Wiener- Khinchin  (i.e,,  stationary  second-order)  random  processes. 
Since  such  processes  are  well  categorized  (in  a  mean  square  sense) 
by  their  power  spectral  density,  or,  equivalently,  by  their  autocor¬ 
relation  function,  it  is  of  interest  to  see  what  this  assumption 
implies  about  1/f  processes. 

• 

For  the  process  x(t)  the  autocorrelation  function  will  be  writ¬ 
ten  as 

=  E{x{t)x(t+T)  3  (1) 


In  the  case  where  x(t)  is  at  least  wide-sense  stationary,  the  auto¬ 
correlation  function  depends  only  on  the  time  difference  and  will 
be  written  as  .  In  this  case  the  Fourier  transform  of 

will  be  called  tlie  power  spectral  density  of  the  process  and  will 
be  denoted  by  cpijf(ui)  . 

The  1/f  processes  to  be  investigated  will  be  assumed  to  have  a 
power  spectral  density 

cpjj(aj)  =  (2) 

at  least  for  small  jio|  and  may  be  divided  into  three  classes  of 
interest  by  the  parameter  a.  Since  both  high  and  low  frequency 
problems  will  be  encountered  if  it  is  assumed  that  Eq.  (2)  holds 
for  all  (ju  and  since  low  frequency  problems  are  of  primary  interest 
here,  it  will  be  assumed  that  (?)„(uj)  decreases  sufficiently  rapidly 
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as  a  function  of  |ioj  that  the  high  frequency  behavior  of  x(t)  is 
not  pathological  (e.g.,  it  will  typically  be  asswned  that 


J,  .  «P„(uJ)diu  <  ®  (3) 

|ou|>b  ^ 

for  all  b>0) .  The  three  regions  of  interest  are  a-0,  0<a<l,  and 

Oil. 

% 

If  a«0,  we  have 


lim  o  (w)  =  k 
to-0  * 


Now  assuming  that  no  singularities,  integrable 

function  of  t.  Under  the  assumption  that  cpxCw)  is  integrable,  Rx\t) 
is  finite  and  therefore  E{x2(t) j<®  Of  course,  in  the  case  where 
CF^{u»)=ku)®=k  for  all  u),  the  autocorrelation  function  is  R^(T)  =  k6(T) 
and  one  encounters  the  high  frequency  difficulties  associated  with 
the  white  noise  idealization  of  random  processes  even  though  there 
are  no  low  frequency  difficulties. 

In  the  case  where  0<a<l,  the  power  spectral  density  given 

by  Eq,  (2)  has  a  Fourier  transform 


2r(a)co8^ 


(4) 


This  function  is  unbounded  at  the  origin,  implying  that  E(x^(t) )="• 
This  difficulty,  however,  is  generated  by  the  high  frequency  behavior 
of  cpjj(tt))  and  may  be  eliminated  by  an  assumption  such  as  Eq.  (3). 
Processes  of  interest  with  0<a<l  have  power  spectral  density  given 
by 


~  klmj”*^  g(ttj)  (5) 

where  g((i))  is  slowly  varying  for  small  {u)|  and  decreases  at  least 
as  fast  as  j'juj  ^  for  large  ju>j.  It  can  be  seen  that  Eq.  (4) 
approaches  k6(T)  as  cl-*0  but  is  degenerate  as  a-*l.  The  case  0«x<l 
is  thus  consistent  with  Wiener- Khinchin  theory  although  some  special 
results  of  the  theory  (i.e.,  those  which  depend  on  cpj,(0)  being  finite) 
cannot  necessarily  be  applied. . 

The  last  region  of  interest  is  where  cutl.  this  case,  since 

b 

J  k  10)1“  dm  =  «, 

0 


all  b>0 


(6) 


the  function 


UJ 

(7) 

is  unbounded.  The  Fourier  transform  of  cpjj(to)  is  not  positive  defin¬ 
ite  [1]  and  thus  cannot  be  the  autocorrelation  function  of  a  Wiener- 
Khinchin  random  process.  Power  spectral  densities,  then,  which  are 
proportional  to  v.»here  ct^l  for  all  ivuj<b,  are  not  admissible. 

In  order  to  accommodate  such  processes  in  the  Wiener- Khinchin  theory, 
it  must  be  assumed  that  there  is  a  non-zero  frequency  W  below  v;hich 

cpjj(ut')  ^  kju)j“^  ,  a<l  (8) 

It  is  this  third  class  which  presents  the  greatest  difficulty.  The 
unbounded  amount  of  low  frequency  energy  is  analogous  to  the  unbounded 
high  frequency  energy  of  white  noise  processes. 

2,  OBSERVATIONS  OP  1/f  PROCESS.ES 

The  sample  power  spectral  density  of  a  wide  class  of  processes 
has  demonstrated  a  1/f  type  behavior  over  a  v;ide  range  of  frequencies. 
Some  areas  in  which  these  processes  have  been  observed  are  noise 
in  solid  state  devices  [2],  fluctuations  of  precise  frequency  stan¬ 
dards  [31,  and  the  spectrum  of  ocean  waves  [4].  In  some  cases  the 
behavior  has  been  observed  over  many  decades  of  frequency. 

Since  the  minimum  frequency  at  which  the  power  spectral  density 
of  a  physical  process  can  be  estimated  is  limited  by  the  necessarily 
finite  observation  time,  a  common  approach  toward  accommodating  l/f°- 
type  processes  Into  the  second  order  theory  is  to  impose  a  non-zero 
low  frequency  limit  on  the  1/f  behavior  of  the  process  and  to  assume 
that  the  power  spectral  density  approaches  a  limit  as  f  approaches 
zero.  As  was  seen  in  the  previous  section,  this  assumption  is  un¬ 
necessary  where  a<l  and  even  in  cases  where  cTfel  the  assumption  is 
not  completely  satisfactory.  The  assumed  low  frequency  limit  has 
never  been  observed  and  measurement  of  extremely  precise  crystal 
oscillators  have  indicated  that  there  are  processes  for  which  any 
low-frequency  limit  would  have  to  be  less  than  3X1G“®  Hz.  An  addi¬ 
tional  difficulty  associated  with  the  low-frequency  limit  W  is  that 
the  process  variance 

«0 

0^,  =  E{x^{t)}  =  ^  J  (9) 

is  strongly  dependent  on  the  value  of  W. 

Estimation  of  sample  pov/er  spectral  densities  of  continuous 
records  at  very  low  frequencies  requires  very  narrow-band  frequency 
estimates  and  therefore  very  long  lag  windows  or  averaging  times  [5], 
In  practical  cases  the  assumption  of  stationarity  of  either  the 
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measurement  or  the  measured  process  is  often  questionable  for  the 
time  interval  required.  For  interval.*?  of  more  acceptable  length  the 
variance  of  the  estimate  of  the  power  spectral  density  is  so  high 
as  to  make  its  value  worthless. 

Digital  processing  of  sampled  data  relieves  many  of  the  con-' 
straints  on  the  measurement  process  but  relies  on  exact  knowledge  of 
the  mean  of  the  process  or  on  techniques  to  remove  the  unknown  mean. 
Unlike  the  continuous  time  case  in  which  the  inherent  high  pass 
nature  of  the  measurement  apparatus  removes  the  d-c  value  of  tiie 
process  x(t),  digitally  processed  samples  of  x(t)  will  assign  all 
of  the  energy  due  to  the  average  value  of  x{t)  to  the  lowest  frequeu' 
cy  values,  thus  artificially  biasing  the  low  frequency  estimates 
of  the  power  spectral  density.  Techniques  have  been  developed  f5] 
to  reduce  the  effect  of  E{x(t)]  on  the  spectral  estimates.  However 
determination  of  such  parameters  as  a  from  low  frequency  sample 
spectra  has  been  only  moderately  successful. 

One  approach  to  the  estimation  of  1/f  type  power  spectral  den- 
si  tL  es  relies  on  the  fact  that  the  expected  value  of  the  variance 
of  the  process  with  a  power  spectral  density  of  the  form  of  Eq.  (2) 
for  low  frequencies  is  a  function  of  N,  the  number  of  samples,  and 
of  a.  The  following  relationships  can  be  shown  to  hold  [61 : 

,  N-1 

<x(t)):;4  2  x(t-+nT)  (10) 

^  n  0  ^ 

and 

<o^(N,T))  -  (11) 

where  u=^-l/  (' )  indicates  time  average,  and  a(|j)  is  a  constant 
depending  on  the  value  of  p.  If  the  quantity 

S(N,u)  r  (12) 

<a^(2,T)> 

is  known  for  several  values  of  N,  the  values  of  u  (and  therefore  a) 
can  be  approximated  for  the  process.  Using  this  procedure,  Allan  [6) 
found  that,  for  "flicker"  noise  in  cesium  beam  frequency  standards, 
H=-2/3.  In  other  words,  for  low  frequencies, 

<P^(u))  (13) 

The  function  S(N,  ji)  is  an  increasing  function  of  N  and,  as  (tt-'l) 

we  have 


2{N-l)-tn2 


S(N,0)  = 
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and  as  the  quantity  S(N,0)  is  unbounded  , 

Thus,  with  proper  consideration  of  the  variance  of  finite  length 
ScURples,  processes  have  been  foxind  which  correspond  to  the  second 
case  0<a<l. 

3.  PHYSICALLY  MOTIVATED  MODELS  FOR  SHOT  PROCESSES 

Shot  process  models  have  been  proposed  as  physically  motivated 
models  for  many  noise  processes,  in  particular,  for  noise  generated 
in  vacuum  tubes  and  in  solid-state  devices  [7] .  The  shot  process  F(t) 
is  given  by 

F(t)  =2  f.  (t  -  t.)  (14) 

i  ^  ^ 

where  fj^(t)  are  the  basic  events  of  the  process  and  the  t^  are  the 
occurrence  times.  The  t^  will  be  considered  to  constitute  a  Poisson 
process.  The  fi(t)  may  be  deterministic  time,  functions  or  may  them¬ 
selves  depend  on  a  random  parameter.  In  the  particular  case  to  be 
considered  fi(t)  v;ill  be  given  by  fCbjif)  where  the  are  independ¬ 
ent  identically  distributed  random  variables  which  will  be  related 
to  the  "duration"  of  the  event  fi(t).  The  shot  process  to  be  con¬ 
sidered  is  thus  given  by 

F(t)  =  E  f{t- t.,  T.)  (15) 

X  11 

It  is  shown  in  [7]  that  the  power  spectral  density  c£)p(uj)  of  P(t) 
is  given  by 

CRp(uj)  =  vE{  |cd^(u),t)  1^)  (16) 

where  v  is  the  average  rate  of  the  Poisson  process  and  <¥>jp(uJ,T)  is 
the  Fourier  transform  of  f(t,T). 

Let  us  assume  that 

P  ('’■)=  c  ,  a^<T<a2  (17) 

where  pC^")  is  the  common  probability  density  function  of  the  and 
m^^  (I )  is  given  by 

m.  (t)  =  f  f(t,T)dt  (18) 

^  i® 

Then  it  is  shown  in  [7]  that,  for  (1/32’ «tiJ«  (l/aj^) » 

cpp  (lu)  «  K/to 


(19) 
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ovS  model  which  approximates  a  1/f  process 

stantraraii  S.  U  (a^paoding  on  the  con- 

such  a  process.^  Let  instructive  to  consider  an  example  of 


~t/T 


,  tiiO 


°  ^  0  ,  t<0 

and  assume  that  the  random  variable  t  has  probability  density 


P('r)  ={ 


0 


2  »  a^sr^a2 

t  elsewhere 


Then  the  power  spectral  density  cp^((o,t)  becomes 


(21) 


CPf(u„T) 


U)T 


®nd  cpp  (u))  becomes 


va^  a. 


a. 


l]L  1+tO  T 


_  1^-1 


~  [  tan’"  (ma.2)-tan“^  (maj^)] 
For  {l/a2)«to«(l/a^),  this  last  expression  becomes 


(22) 


(23) 


TTva.  a«  , 

(<«)  «  ^ 
^  ^  (a2—a^ )  a) 


(24) 


■It  should  be  noted  that,  as  ur-0,  CDp(aO<K/a,  as  reaquired  in  Section  1, 

?Si^rrL;™oaIfw^s 


^  ftan  ^  (la*?  j^)  ~  tan’"^  {u,T2)] 


(25) 
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where  K,  and  r2  are  physical  parameters  depending  upon  the 
material  and  surface  involved.  This  power  spectral  density  is 
precisely  that  given  for  the  Poisson  shot  process  just  discussed. 
An  indication  of  the  behavior  of  fit,"!)  is  shown  in  Fig.  2  and  a 
typical  density  p{T)  is  given  in  Fig.  1.  A  comparison  of  "pCuj) 
for  the  process  with  this  p('^)  and  a  K/w  spectrum  is  shown  in 


The  exiscence  of  processes  consisting  of  events  having  widely 
distributed  duration  tine  has  been  described  by  several  authors. 

In  a  report  on  1/f  noise  in  thin  evaporated  films,  for  example, 
Osman  [8]  has  determined  the  pulse  duration  due  to  election  tunnel¬ 
ing  to  be  given  approximately  by 


T  =  10“'^^'*'^  seconds  (26) 

where  s  is  the  barrier  thickness  in  Angstrom  units  (1  angstrom 
unit  =  10“^^  meter).  A  variation  in  barrier  thickness  of  5-20 
angstroms  is  sufficient  to  account  for  pulse  durations  ranging  over 
fifteen  orders  of  magnitude  (10"^^  to  iC^  seconds).  Thus  reasonable 
physical  mechanisms  have  been  described  which  can  lead  to  1/f  type 
behavior  of  a  shot  process  over  a  very  large  frequency  range. 

Shot  models,  then,  can  provide  reasonable  physically  motivated 
models  for  some  1/f  type  processes.  These  models  are  particularly 
attractive  for  modeling  noise  in  solid  state  devices  where  appropri¬ 
ate  physical  mechanisms  for  generation  of  these  processes  have  been 
described.  The  particular  model  discussed  is  appropriate  for  1/f 
processes  in  the  third  class  (as  1)  and  has  the  low  frrquency  limit 
W  inherent  in  the  model. 

4.  SPORADIC  RANDOM  PROCESSES 

The  term  "'flicker  processes"  was  ascribed  to  processes  with 
1/f^  type  pov;er  spectral  densities  because  of  the  apparent  nonsta- 
tionarity  of  these  processes  when  observed  over  finite  time  inter¬ 
vals.  This  behavior  is  due  to  the  dominance  of  lo^^'  frequency 
energy  in  these  processes  but  is  not  typical  of  the  behavior 
expected  for  stationary  second  order  random  processes.  The  previous 
discussions  have  been  concerned  primarily  with  accomodating  these 
processes  to  the  familiar  framework.  From  a  finite  sample  of  a 
process  x\t),  hov;ever,  it  is  impossible  to  determine  if  the  process 
is  a  stationary,  second  order  process  and  even  the  practical  value 
of  specifying  the  behavior  of  the  process  over  all  time  may  be 
questioned.  Thus  a  process  v/hich  is  stationary  over  an  interval 
which  is  long  compared  with  the  sampling  interval  may  for  all 
practical  purposes  be  considered  tc  be  a  stationary  process.  The 
concept  of  a  sporadic  random  process  was  introduced  by  Mandelbrot 
[9]  to  characterize  processes  whose  behavior  can  be  divided  into 
periods  of  activity  and  periods  of  inactivity.  These  processes 
cannot  always  be  accomodated  in  the  Wiener-Khinchin  theory.  For 
example,  a  randcrn  process  of  the  type  described  below  is  not  a 
stationary  second  order  random  process: 
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1)  x(t)  is  almost  surely  constant  in  every  finite  interval 
(t.i,t2) 

2)  x(t)  almost  surely  varies  for  some  t,  -oo<t<aj. 

Sporadic  random  processes  do  not  necessarily  possess  a 
Wiener-Khinchin  power  spectral  density  but  do  possess  a  conditional 
spectral  density  (conditioned  on  the  periods  of  activity  of  the 
process)  which  may  vary  as  u}“^L(u))  for  small  u)  where  05a^2  and 
L(iu)  is  a  function  which  varies  slowly  at  the  origin*.  3otne 
sporadic  random  processes  have  been  shown  [10]  to  possess  the 
erratic  sampling  behavior  associated  with  1/f  processes.  A  basic 
sporadic  random  process  is  the  process  which  is  constant  with  a 
single  discontinuity  at  the  point  t=T.  This  point  is  uniformly 
distributed  over  all  t  (the  random  variable  T  is  a  generalized 
random  variable  in  the  sense  of  Mandelbrot  [9] ) .  This  process  can 
be  represented  by 

,  tJJT 
{  X2  ,  t>T 

where  Xj^  and  X2  are  independent  identically  distributed  random 
variables.  This  process  does  not  possess  a  VJiener-Khinchin  spectral 
density  but  has  a  conditional  spectral  density  which  is  proportional 
to  |(«|“2  for  small  uj.  Sporadic  random  processes  therefore  offer  a 
generalization  of  Wiener-Khinchin  random  processes  and  the  condition¬ 
al  spectral  density  of  these  processes  may  provide  an  interpretation 
of  measurements  intended  to  measure  the  Wiener-Khinchin  spectral 
dens; ‘y. 

5.  CONCLUSION 

Several  different  approaches  have  been  followed  in  an  investi¬ 
gation  of  1/f  processes.  While  each  of  these  appear  particularly 
suited  to  one  type  of  process  (i.e.  one  particular  range  of  a)  tlie 
approaches  are  not  mutually  exclusive  and  provide  among  them  an 
interpretation  for  the  majority  of  thn  low  frequency  noise  problems 
observed  to  date. 

These  models  are  physical  in  the  sense  that  the  primary 
rationale  behind  the  modelling  is  to  explain  observed  phenomena. 
However,  the  universality  of  the  1/f^  phenomena  would  argue 
against  the  applicability  of  a  single  model  closely  associated 
with  the  physics  of  a  particular  situation. 


*L(uj)  varies  slow^ly  at  the  origin  in  the  sense  of  Karamata 
if,  for  every  h>0 


lira  L{h(r)/L  (id)  =  1 
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'>xA  noise  phenomenon  which  is  often  dominant  at  low  frequencies  is 
comprised  of  those  processes  which  are  called  1/f  noise,  flicker 
effect,  and  sporadic  processes.  These  proc.ess.es  are  characterized  by 
a  power  spectral  density  which  varies  as  l/jf]^  where  ;6i:a^ 2. They 
have  been  observed  over  a  wide  range  of  frequencies  in "such  diverse 
situations  as  vacuum  tube  and  semiconductor  noise,  the  spectrura  of  sea 
waves,  and  ultra-precise  time  standards.  Some  of  these  processes  are 
not  admissable  in  the  usual  Wiener-Khinchin  theory  of  random  processes. 
On  the  other  hand,  their  extensive  occurrence  suggests  that  some 
accomodation  must  be  made  for  them  in  the  organized  theory. 

It  is  the  purpose  of  this  paper  to  consider  several  approaches  to 
the  modeling  of  such  1/f  processes.  It  will  be  shown  that  models  do 
exist  which  satisfactorily  explain  observed  phenomena  while  retaining 
adequate  connection  with  the  underlying  physics  of  the  model. 


